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DETAILED ACTION 

Response to Arguments 

1 . Applicants arguments with respect to claims 1 , 5, 7, 9 -1 1 , 14, 15, 18, 20, and 22- 
24 have been considered but are moot in view of the new grounds of rejection. 
Examiner has withdrawn Bangalore et al. US 20050135571 A1 (hereinafter Bangalore), 
wherein the claim language is no longer directed to completion of fields in a form. 
Examiner instead incorporates Guo et al. US 7610556 B2 (hereinafter Guo) to address 
audible dialog with a change in order such as providing consecutive audible prompts to 
address both a response and additional information from a user. Guo specifically 
handles additional responses to a single prompt based on dialog and not fields within a 
form only. Guo is directed to audible prompting for out of order sequences when 
secondary dialogs take place, such as sub dialogs. Guo teaches a system that actively 
provides the user with useful information related to a particular topic, wherein execution 
of a particular sub-task may be interrupted by the user when the user initiates a sub- 
dialog. In that event, the system will begin again to continue on with its previous tasks 
after completion of the sub-dialog (Guo [0076]). Additionally, Tackett et al. US 661 51 1 1 
B2 (hereinafter Tackett) has been incorporated to address dialog based servers and 
clients in place of Albayrak. 
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Claim Rejections - 35 USC §103 

2. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 1 , 5, 7, 9-1 1 , 1 4, 1 5, 1 8, 20, and 22-31 are rejected under 35 

U.S.C. 103(a) as being unpatentable over Alpdemir US 20020035474 A1 (hereinafter 
Alpdemir) in view of Tackett et al. US 66151 1 1 B2 (hereinafter Tackett) and further in 
view of Guo et al. US 7610556 B2 (hereinafter Guo). 

Re claims 1 and 26, Alpdemir teaches a computer readable storage medium 
having instructions, which when executed on a computer generate client side markup 
([0140]) for a client in a client/server system, the instructions comprising: 

a module, when executed on a process of a computer associated with the client, 
creates a dialog with a user ([0139]) using client side markup generated as a function 
of a set of controls, wherein the client side markup includes markup related to audible 
prompting of a plurality of questions ([0226]) and markup related to a grammar for 
recognition ([01 69]) as a function of responses from the user ([01 43-01 44]), wherein the 
client side markup is adapted to prioritize prompting of the plurality of questions ([0337- 
0339]) and generate audible prompts for the plurality of questions in a selected order as 
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related to an order of the controls ([0222 & 02223] & Fig. 5 ordered set of 
commands/responses) 

wherein using the client side markup, the dialog follows the selected order of 
prompting to provide audible prompts to the user for one or more of the plurality of 
questions and receive one or more responses to the audible prompts from the user 
([0222 & 02223] & Fig. 5 ordered set of commands/responses) 

wherein the dialog departs from the selected order to provide an additional 
prompt ([0143-0144]) 

when a response provided by the user to a previous audible prompt that given in 
the selected order includes both the previous audible prompt and additional information 
that is not an answer to the prompt that was given, 

wherein the additional prompt is provided to the user concerning the additional 
information before the dialog returns to the selected order to provide a next audible 
prompt that follows the previous audible prompt in the selected before returning to the 
selected order 

However, Alpdemir fails to teach maintaining, in a stack, a reference to the one 
or more semantic items in the semantic map associated with the additional information 

a client side markup for a client in a client/server system 

a semantic map includes a plurality of semantic items that maintain information 
related to responses received from the user for the questions in the dialog wherein the 
dialog 
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following the selected order to generate one or more audible prompts for one or 
more of the questions 

receiving a user response to one of the audible prompt that includes an answer 
to a question associated with the audible prompt and additional information provided in 
the user response with the answer, the additional information not being an answer to 
the question 

storing values for the answer and the additional information in the semantic map, 
wherein the answer is associated with one or more semantic items in the semantic map 
and the additional information is associated with one or more semantic items in the 
semantic map 

Tackett teaches well known uses of dialog interaction with a system in a client 
and server system (Tackett Fig. 3). 

Further, Tackett teaches the use of stack to remember the meaning and order of 
spoken information with an automated system for execution at a later time (Tackett Col. 
35 lines 15-37) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir to incorporate a client side 
markup for a client in a client/server system as taught by Guo to allow for the use of a 
remote computer system or chat server (Tackett Fig. 3), wherein a system can 
remember the meaning and order of spoken information with an automated system for 
execution at a later time (Tackett Col. 35 lines 15-37). 
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However, Alpdemir in view of Tackett fails to teach when a response provided by 
the user to a previous audible prompt that given in the selected order includes both the 
previous audible prompt and additional information that is not an answer to the prompt 
that was given, 

wherein the additional prompt is provided to the user concerning the additional 
information before the dialog returns to the selected order to provide a next audible 
prompt that follows the previous audible prompt in the selected before returning to the 
selected order 

Guo teaches a system that actively provides the user with useful information 
related to a particular topic, wherein execution of a particular sub-task may be 
interrupted by the user when the user initiates a sub-dialog. In that event, the system 
will begin again to continue on with its previous tasks after completion of the sub-dialog 
(Guo [0076]). 

Further, Guo demonstrates this concept, where a user responds to a prompt by 
including information about the prompt (i.e. introduction) and an interest in another 
topic. Further, the system begins a prompt explaining about a meridian gate (9) and the 
user asks for the height (10), the system then responds with the height (11) and 
continues where it left off at (9) at (13) [0041-0055]). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir in view of Tackett to incorporate 
when a response provided by the user to a previous audible prompt that given in the 



Application/Control Number: 10/755,623 Page 7 

Art Unit: 2626 

selected order includes both the previous audible prompt and additional information that 
is not an answer to the prompt that was given, and wherein the additional prompt is 
provided to the user concerning the additional information before the dialog returns to 
the selected order to provide a next audible prompt that follows the previous audible 
prompt in the selected before returning to the selected order as taught by Guo to allow 
for a particular sub-task that may be interrupted by the user when the user initiates a 
sub-dialog, wherein a system will begin again to continue on with its previous tasks after 
completion of the sub-dialog (Guo [0076]). 

Re claim 5, Alpdemir teaches the computer readable storage medium of claim 1 
wherein one of the controls provides means for defining a confirmation for generating 
markup related to confirming that a recognized result is correct ([0191]). 

Re claims 7, 14, and 29, Alpdemir teaches the computer readable storage 
medium of claim 1 wherein the module maintains information related to an order of 
responses received from the user, and wherein the module departs from the selected 
order ([0337-0339]) to provide a prompt related to a previous [RLI0] response from the 
user in the information ([0143-0144]). 

However, Alpdemir in view of Tackett fails to teach providing a prompt related to 
a previous [RLI0] response from the user. 
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Guo teaches a system that actively provides the user with useful information 
related to a particular topic, wherein execution of a particular sub-task may be 
interrupted by the user when the user initiates a sub-dialog. In that event, the system 
will begin again to continue on with its previous tasks after completion of the sub-dialog 
(Guo [0076]). 

Further, Guo demonstrates this concept, where a user responds to a prompt by 
including information about the prompt (i.e. introduction) and an interest in another 
topic. Further, the system begins a prompt explaining about a meridian gate (9) and the 
user asks for the height (10), the system then responds with the height (11) and 
continues where it left off at (9) at (13) [0041-0055]). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir in view of Tackett to incorporate 
providing a prompt related to a previous [RLI0] response from the user as taught by 
Guo to allow for a particular sub-task that may be interrupted by the user when the user 
initiates a sub-dialog, wherein a system will begin again to continue on with its previous 
tasks after completion of the sub-dialog (Guo [0076]). 

Re claims 9 and 30, Alpdemir teaches the computer readable storage medium of 
claim 8 wherein module maintains the information related to an order of responses 
([0337-0339]) received from the user as a stack. 

However, Alpdemir fails to teach an order of responses received from the user as 
a stack 
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Tackett teaches well known uses of dialog interaction with a system in a client 
and server system (Tackett Fig. 3). 

Further, Tackett teaches the use of stack to remember the meaning and order of 
spoken information with an automated system for execution at a later time (Tackett Col. 
35 lines 15-37) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir to incorporate an order of 
responses received from the user as a stack as taught by Guo to allow for the use of a 
remote computer system or chat server (Tackett Fig. 3), wherein a system can 
remember the meaning and order of spoken information with an automated system for 
execution at a later time (Tackett Col. 35 lines 15-37). 

Re claims 1 0, 20, 28, and 31 , Alpdemir fails to teach the computer readable 
storage medium of claim 9 wherein the stack is of selected length such that the oldest 
information related to the oldest received response is removed when information is 
received related to the latest response from the user. 

Tackett teaches well known uses of dialog interaction with a system in a client 
and server system (Tackett Fig. 3). 

Further, Tackett teaches the use of stack to remember the meaning and order of 
spoken information with an automated system for execution at a later time (Tackett Col. 
35 lines 15-37) 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir to incorporate the stack is of 
selected length such that the oldest information related to the oldest received response 
is removed when information is received related to the latest response from the user as 
taught by Guo to allow for the use of a remote computer system or chat server (Tackett 
Fig. 3), wherein a system can remember the meaning and order of spoken information 
with an automated system for execution at a later time (Tackett Col. 35 lines 15-37). 

Re claim 1 1 , Alpdemir teaches a computer implemented method for performing 
recognition and/or audible prompting on a client in a client/server system, the method 
comprising: 

receiving client side markup, the client die markup including markup related to 
audible prompts of questions and markup related to a grammar used for recognition as 
a function of responses from a user ([0139]), wherein the markup defines selected order 
of the questions ([0226])to prioritize prompting of the questions in a dialog with a user 
([0337-0339]) 

creating the dialog on a client as a function of execution of the client side markup 
related to the controls using a processor of a computer, wherein 

a semantic map includes a plurality of semantic items that maintain information 
related to responses received from the user for the questions in the dialog wherein the 
dialog, wherein creating the dialog comprises: 
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following the selected order to generate one or more audible prompts for one or 
more of the questions 

receiving a user response to one of the audible prompt that includes an answer 
to a question associated with the audible prompt and additional information provided in 
the user response with the answer, the additional information not being an answer to 
the question 

However, Alpdemir fails to teach maintaining, in a stack, a reference to the one 
or more semantic items in the semantic map associated with the additional information 

a client side markup for a client in a client/server system 

a semantic map includes a plurality of semantic items that maintain information 
related to responses received from the user for the questions in the dialog wherein the 
dialog 

following the selected order to generate one or more audible prompts for one or 
more of the questions 

receiving a user response to one of the audible prompt that includes an answer 
to a question associated with the audible prompt and additional information provided in 
the user response with the answer, the additional information not being an answer to 
the question 

storing values for the answer and the additional information in the semantic map, 
wherein the answer is associated with one or more semantic items in the semantic map 
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and the additional information is associated with one or more semantic items in the 
semantic map 

Tackett teaches well known uses of dialog interaction with a system in a client 
and server system (Tackett Fig. 3). 

Further, Tackett teaches the use of stack to remember the meaning and order of 
spoken information with an automated system for execution at a later time (Tackett Col. 
35 lines 15-37) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir to incorporate a client side 
markup for a client in a client/server system, use of stack to maintain semantic entities, 
a semantic map includes a plurality of semantic items that maintain information related 
to responses received from the user for the questions in the dialog wherein the dialog , 
as well as storing values for the answer and the additional information in the semantic 
map, wherein the answer is associated with one or more semantic items in the semantic 
map and the additional information is associated with one or more semantic items in the 
semantic map as taught by Guo to allow for the use of a remote computer system or 
chat server (Tackett Fig. 3), wherein a system can remember the meaning and order of 
spoken information with an automated system for execution at a later time (Tackett Col. 
35 lines 15-37). 
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However, Alpdemir in view of Tackett fails to teach following the selected order to 
generate one or more audible prompts for one or more of the questions 

receiving a user response to one of the audible prompt that includes an answer 
to a question associated with the audible prompt and additional information provided in 
the user response with the answer, the additional information not being an answer to 
the question 

before proceeding with a next question that follows the question in the selected 
order, departing from the selected order of the questions by accessing stack and 
identifying the one or more semantic items associated with the additional information 
and, in response, generating an additional audible prompt that is related to the 
additional information, 

after the user has provided a response to the additional audible prompt, returning 
to the selected order of the questions to generate a next audible prompt for the next 
question 

Guo teaches a system that actively provides the user with useful information 
related to a particular topic, wherein execution of a particular sub-task may be 
interrupted by the user when the user initiates a sub-dialog. In that event, the system 
will begin again to continue on with its previous tasks after completion of the sub-dialog 
(Guo [0076]). 

Further, Guo demonstrates this concept, where a user responds to a prompt by 
including information about the prompt (i.e. introduction) and an interest in another 
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topic. Further, the system begins a prompt explaining about a meridian gate (9) and the 
user asks for the height (1 0), the system then responds with the height (1 1 ) and 
continues where it left off at (9) at (13) [0041-0055]). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir in view of Tackett to incorporate 
following the selected order to generate one or more audible prompts for one or more of 
the questions, receiving a user response to one of the audible prompt that includes an 
answer to a question associated with the audible prompt and additional information 
provided in the user response with the answer, the additional information not being an 
answer to the question, before proceeding with a next question that follows the question 
in the selected order, departing from the selected order of the questions by accessing 
stack and identifying the one or more semantic items associated with the additional 
information and, in response, generating an additional audible prompt that is related to 
the additional information, after the user has provided a response to the additional 
audible prompt, returning to the selected order of the questions to generate a next 
audible prompt for the next question as taught by Guo to allow for a particular sub-task 
that may be interrupted by the user when the user initiates a sub-dialog, wherein a 
system will begin again to continue on with its previous tasks after completion of the 
sub-dialog (Guo [0076]). 
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Re claims 15 and 27, Alpdemir teaches the computer implemented method of 
claim 14 wherein the set of controls includes an attribute to indicate whether a response 
to a prompt will be maintained in the information related to the order of responses 
received from the user ([0337-0339]), and wherein creating the dialog includes 
maintaining information related to an order of responses received from the user as a 
function of the corresponding attribute for a prompt ([0226]). 

Re claim 18, computer implemented method of claim 14, wherein defining a 
dialog includes logic for modifying the maintained information related to an order of 
responses received from the user ([0337-0339]), and wherein creating the dialog 
includes modifying the maintained information pursuant to the logic ([0213). 

Re claim 22, Alpdemir teaches the system of claim 20 wherein the ordered list is 
indicative of a list of semantic items ([0250-0338] & Fig. 5, examples illustrating prompt 
and response in a dialog environment, where the best matching data to a user response 
is selected from a set of data). 

Re claim 23, Alpdemir fails to teach the computer implemented method of claim t 
1 , wherein the stack maintains references to a plurality of the semantic items in a 
manner to indicate when the plurality of semantic items have been modified, to reflect 
responses received, relative to one another. 
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Tackett teaches well known uses of dialog interaction with a system in a client 
and server system (Tackett Fig. 3). 

Further, Tackett teaches the use of stack to remember the meaning and order of 
spoken information with an automated system for execution at a later time (Tackett Col. 
35 lines 15-37) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir to incorporate the stack maintains 
references to a plurality of the semantic items in a manner to indicate when the plurality 
of semantic items have been modified, to reflect responses received, relative to one 
another as taught by Guo to allow for the use of a remote computer system or chat 
server (Tackett Fig. 3), wherein a system can remember the meaning and order of 
spoken information with an automated system for execution at a later time (Tackett Col. 
35 lines 15-37). 

Re claim 24, Alpdemir fails to teach the computer implemented method of claim 
23, wherein departing from the selected order comprises accessing the stack and 
identifying a first semantic item referenced in the stack, the first semantic item having 
been modified more recently than other semantic items referenced in the stack 

Tackett teaches well known uses of dialog interaction with a system in a client 
and server system (Tackett Fig. 3). 
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Further, Tackett teaches the use of stack to remember the meaning and order of 
spoken information with an automated system for execution at a later time (Tackett Col. 
35 lines 15-37) 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir to incorporate accessing the 
stack and identifying a first semantic item referenced in the stack, the first semantic item 
having been modified more recently than other semantic items referenced in the stack 
as taught by Guo to allow for the use of a remote computer system or chat server 
(Tackett Fig. 3), wherein a system can remember the meaning and order of spoken 
information with an automated system for execution at a later time (Tackett Col. 35 lines 
15-37). 

Re claim 25, Alpdemir in view of Tackett fails to teach the computer implemented 
method of claim 1 1 , comprising: 

receiving a first user response to the audible prompt from a first user, the first 
user response comprising an answer to the question associated with the audible prompt 
and a first combination of additional information, the first 

combination of additional information not being an answer to the question; 

departing from the selected order of the questions by generating a first series of 
additional audible prompts related to the first combination of additional information; 

receiving a second user response to the audible prompt from a second user, the 
second user response comprising an answer to the question associated with the audible 
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prompt and a second combination of additional information, the second combination of 
additional information not being an answer to th 

question and being different than the first combination of additional information; 

and 

departing from the selected order of the questions by generating a second series 
of additional audible prompts related to the second combination of additional 
information, the second series of additional audible prompts being different than the first 
series of additional audible prompts 

Guo teaches a system that actively provides the user with useful information 
related to a particular topic, wherein execution of a particular sub-task may be 
interrupted by the user when the user initiates a sub-dialog. In that event, the system 
will begin again to continue on with its previous tasks after completion of the sub-dialog 
(Guo [0076]). 

Further, Guo demonstrates this concept, where a user responds to a prompt by 
including information about the prompt (i.e. introduction) and an interest in another 
topic. Further, the system begins a prompt explaining about a meridian gate (9) and the 
user asks for the height (1 0), the system then responds with the height (1 1 ) and 
continues where it left off at (9) at (1 3) [0041 -0055]). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to modify the system of Alpdemir in view of Tackett to incorporate 
receiving a first user response to the audible prompt from a first user, the first user 
response comprising an answer to the question associated with the audible prompt and 
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a first combination of additional information, the firstcombination of additional 
information not being an answer to the question; departing from the selected order of 
the questions by generating a first series of additional audible prompts related to the 
first combination of additional information; receiving a second user response to the 
audible prompt from a second user, the second user response comprising an answer to 
the question associated with the audible prompt and a second combination of additional 
information, the second combination of additional information not being an answer to 
the question and being different than the first combination of additional information; and 
departing from the selected order of the questions by generating a second series of 
additional audible prompts related to the second combination of additional information, 
the second series of additional audible prompts being different than the first series of 
additional audible prompts as taught by Guo to allow for a particular sub-task that may 
be interrupted by the user when the user initiates a sub-dialog, wherein a system will 
begin again to continue on with its previous tasks after completion of the sub-dialog 
(Guo [0076]). 



Conclusion 

4. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 
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A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to MICHAEL C. COLUCCI whose telephone number is 
(571)270-1847. The examiner can normally be reached on 8:30 am - 5:00 pm , Monday 
- Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571)-272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-91 99 (IN USA OR CANADA) or 571 -272-1 000. 



/Michael C Colucci/ 
Examiner, Art Unit 2626 
Patent Examiner 
AU 2626 
(571)-270-1847 

Examiner FAX: (571)-270-2847 

Michaei.Colucci@uspto.gov 



/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



